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Charge Diffusion Crosstalk Reduction for Image Sensors 

Field of the Invention 

The present invention relates generally to image processing, and more 
particularly to image processing in color CMOS image sensors. 

Backeround of the Invention 

Electronic image sensors are widely used to produce video and 
photographic images. The electronic image sensors typically comprise pixel sensors that 
are arranged in an array of rows and colxmms. The image sensors typically read pixel 
values by using a horizontal scan circuit to sequentially address pixel columns. A charge 
amplifier is often used to read the charge of pixels within the addressed pixel columns. 

As pixel pitches decrease, charge diffusion crosstalk increases. The 
crosstalk between neighboring pixels causes color-shifting problems in the image 
captured by the electronic sensor. Color-shifting occurs when monochromatic light (e.g., 
red, green, or blue) is shifted from its true color a result of the addition of diffused charge 
from neighboring pixels of different colors. The effect of color-shifting increases as pixel 
pitch decreases. Crosstalk is a function of doping concentration, charge free running 
distance and layout structure. For small pixels (e.g., 3.2um pitch pixel with 0.1 Sum 
advanced CMOS processing), crosstalk of red light can be as high as 20%, which can 
cause very noticeable color-shifting in a captm-ed image. 

An appreciation of the present invention and its improvements can be 
obtained by reference to the accompanying drawings, which are briefly summarized 
below, to the following detailed description of illustrated embodiments of the invention, 
and to the appended claims. 

Brief Description of the Drawings 

FIGURE 1 is a schematic diagram of an example color filter mask pattern 
for a CMOS image sensor used in accordance with the present invention. 
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FIGURE 2 is a flow diagram of digital post-processing of an image signal 
from an image sensor in accordance with the present invention. 

FIGURE 3 is a flow diagram of using crosstalk calibration and color 
correction during digital post-processing of an image signal from an image sensor in 
accordance with the present invention. 

FIGURE 4 is a flow diagram of combining crosstalk calibration with color 
correction during digital post-processing of an image signal from an image sensor in 
accordance with the present invention. 

FIGURE 5 is a signal flow diagram for digital post-processing of an image 
signal from an image sensor in accordance with the present invention. 

Detailed Description of the Preferred Embodiment 
In the following detailed description of exemplary embodiments of the 
invention, reference is made to the accompanied drawings, which form a part hereof, and 
which is shown by way of illustration, specific exemplary embodiments of which the 
invention may be practiced. These embodiments are described in sufficient detail to 
enable those skilled in the art to practice the invention, and it is to be understood that 
other embodiments may be utilized, and other changes may be made, without departing 
from the spirit or scope of the present invention. The following detailed description is, 
therefore, not to be taken in a limiting sense, and the scope of the present invention is 
defined only by the appended claims. 

Throughout the specification and claims, the following terms take the 
meanings explicitly associated herein, unless the context clearly dictates otherwise. The 
meaning of "a," "an," and "the" includes plural reference, the meaning of "in" includes 
"in" and "on." The term "connected" means a direct electrical connection between the 
items connected, without any intermediate devices. The term "coupled" means either a 
direct electrical connection between the items connected, or an indirect connection 
through one or more passive or active intermediary devices. The term "circuit" means 
either a single component or a multiplicity of components, either active and/or passive, 
that are coupled together to provide a desired fimction. The term "signal" means at least 
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one current, voltage, or data signal. Referring to the drawings, like numbers indicate like 
parts throughout the views. 

CMOS image sensors typically comprise pixel cells (i.e., pixels) that are 
arranged in an array. Each pixel typically comprises a reset circuit and a photodiode, 
which are used to produce a pixel signal level in accordance with the intensity of incident 
light. In operation, the reset circuit is used to charge the pixel to a highest level. 
Exposure of the photodiode to light causes the photodiode to produce a stray current, 
which reduces the charge of the pixel over time. Thus, the pixel signal level is integrated 
by exposing the pixel to light. The amoxmt of integration is dependent upon the intensity 
of incident Ught upon the pixel and the sensitivity of the pixel 

A color filter mask is typically superimposed over the pixel array such that 
each pixel is covered with a monochromatic filter of a certain color and that no two 
adjacent pixels have filters of the same color. Color shifting occurs when the incident 
light upon a certain pixel causes firee electrons in the substrate below the pixel to diffuse 
to neighboring pixels. This erroneously causes the pixel (which represents a different 
color than the pixel fi^om which the diffused electrons originated) to be increased beyond 
the *true" representation of the image to be captured. 

A charge diffusion crosstalk reduction process is provided for image 
signals fi"om, for example, a CMOS image sensor. Charge diffusion crosstalk processing 
can be used in accordance with aspects of the present invention to reduce charge 
diffusion crosstalk caused by electrons migrating firom adjacent pixels. Crosstalk effects 
can be determined by color gain and color offset. By adjusting the color gain and color 
offset, crosstalk can be cancelled to the first order. Charge diffusion crosstalk processing 
in accordance with aspects of the present invention can be relatively easily integrated 
with color correction processing during the post processing of image sensors. Color 
correction and cross talk cancellation processing can use the same circuitry as previously 
used before by color correction process only. The input coefficients for color correction 
and cross talk cancellation processing can be determined firom the results of the 
multiplication of color correction matrix C and crosstalk cancellation matrix K'^ . 

FIGURE 1 is a schematic diagram of an example color filter mask pattem 
for a CMOS image sensor used in accordance with the present invention. For simplicity. 
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only a small, representative portion of pattern 100 is shown. The figure illustrates a 
Bayer pattern, which is arranged using an R (red) G (green) B (blue) format. (Other 
patterns and colors are possible for the color filter mask.) Each block (e.g., Ill) 
represents a pixel upon which a color filter (red, green, or blue) has been placed on top of 
the pixel in accordance with the selected pattern. For example, pixel 122 comprises a blue 
filter, pixel 123 comprises a green filter, and pixel 133 comprises a red filter. 

A majority of "stray*' diffused electrons in a particular pixel originate firom 
the eight surrounding pixels that surround the particular pixel. The degree to which the 
electrons migrate to surrounding pixels is a fimction of the depth to which 
monochromatic light travels in the substrate of the pixels fi*om which the electrons 
originate. Blue light reaches only to a shallow depth fi-om the surface of silicon. Green 
Ught reaches more deeply, while red light reaches most deeply. 

Usually, field oxide and/or p or p+ type material is placed between pixels 
to reduce the number of electrons generated between the surface and about 1 um depth 
fi'om the surface fi-om diffiising to neighboring pixels. Accordingly, the crosstalk 
percentage of blue light is the smallest. The crosstalk percentage of green light is higher 
and that of red light is highest. 

For red pixels (e.g., pixel 133), crosstalk mainly originates fi-om within the 
green pixels (e.g., pixels 123, 132, 134, and 143) beside it. A lesser amount of crosstalk 
originates fi-om within the blue pixels (e.g., pixels 124 and 142) at the comers of the 3x3 
array. For green pixels (e.g., pixel 123), the crosstalk mainly originates fi-om within the 
red pixels (e.g., pixels 113 and 133) beside it. A lesser amount of crosstalk originates 
fi-om within the adjacent blue pixels (e.g., pixels 122 and 124) and the adjacent red pixels 
(e.g., pixels 113 and 133). For blue pixels (e.g., pixel 122), the crosstalk mainly 
originates from within the adjacent green pixels (e.g., pixels 112, 121, 123, and 132) and 
the red pixels (e.g., pixels 1 1 1, 1 13, 131, and 133) at the comers of the 3x3 array. 

To simpUfy processing requirements, the same-colored pixels are assumed 
to have same value in a 4x4 array (as shown, for example, in the figure). The crosstalk 
from the center pixel to its upper, lower, right and left neighbors is assumed to be the 
same and the crosstalk from the center pixel to its upper left, upper right, lower left and 
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lower right neighbors is also assumed to be the same. Additionally, only crosstalk within 
a 3x3 array is considered. 



Coefficients for representing crosstalk between pixels are defined as in 
Table 1, below. 

Table 1 



coefficient 


description 


direction 




Cross talk from red pixel to green pixel 


Horizontally or vertically 


krb 


Cross talk from red pixel to blue pixel 


Diagonally 


kbg 


Cross talk from blue pixel to green pixel 


Horizontally or vertically 


kbr 


Cross talk from blue pixel to red pixel 


Diagonally 


kgb 


Cross talk from green pixel to blue pixel 


Horizontally or vertically 




Cross talk from green pixel to red pixel 


Horizontally or vertically 



The measured value of each pixel is actually the summation of the true 
(i.e., desired) value and the crosstalk contribution. In the equations below, R, G and B 
denote the measured values of red, green and blue pixels and Ro, Go and Bo denote the 
tme value of red, green and blue pixels. The relationship between the measured value 
and true value can be expressed by the following equations: 
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(5) 



where denotes the 3x3 coefficients matrix in equation (4). 



Equation (4) shows that the measured pixel value has the format of 
measured _value = gain ' true _value offset . Accordingly, crosstalk contributes to 
both color gain and color offset effects. To reduce these effects, both gain and offset 
calibrations can be used. From equation (5), the true values of red, green and blue pixels 
can be expressed as 
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Go 




G 


A. 
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The K'^ array can be determined by the six coefficients shown in Table 1, which can be 

measured from test chips in advance. When the coefficients of Table 1 are known, the 

true value of pixels can be calculated according to equation (6). Accordingly, the K"^ 

array plays the roll of providing gain and offset calibration for processing a captured 
image. 

FIGURE 2 is a flow diagram of digital post-processing of an image signal 
from an image sensor in accordance with the present invention. In block 210, black level 
compensation is performed to establish a black level for the image signal. In block 220, 
"bad" pixels are compensated for by, for example, averaging neighboring pixel values. 
In block 230, color interpolation is performed. In block 240, color correction is 
performed (as described immediately below). In block 250, gamma correction can be 
performed. 

Color correction (of block 240) can be used to improve the color filter 
spectral response with regards to wavelength selectivity. Color correction can be used to 
suppress other color components present in a colored pixel (e.g. with color filter on). The 
fimction of this process is also to adjust the color gain and subtract other color 
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components, which is similar in fomi to equation (6). Accordingly, crosstalk calibration 
can be used with color processing. An equation for color correction processing can be 
described as 



(7) 
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where R, G and B are the output values of the color correction block. Crosstalk 
calibration can be used with the color correction process as shown in Figure 3. 

FIGURE 3 is a flow diagram of using crosstalk calibration and color 
correction during digital post-processing of an image signal from an image sensor in 
accordance with the present invention. For example, crosstalk calibration (310) can be 
performed before color correction (320). 

The output of the cross talk calibration block and the color correction 
block can be expressed as: 



(9) 



where ^ = £ • ^ \ Accordingly, color correction processing and crosstalk calibration 

processing can be merged without substantial changes to the processing circuitry. The 
combined function typically can be reaUzed by providing different matrix elements to 
existing circuitry. 

FIGURE 4 is a flow diagram of combining crosstalk calibration with color 
correction during digital post-processing of an image signal from an image sensor in 
accordance with the present invention. Block 410 is a representation of combining 
crosstalk calibration with color correction. 

FIGURE 5 is a signal flow diagram for digital post-processing of an image 
signal from an image sensor in accordance with the present invention. As can be seen 
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from the figure, the complete algorithm can be implemented using just three multipliers 
(510, 520, and 530) and two adders (540 and 550). The elements of the matrix T are 
typically all programmable. 

Charge diffusion crosstalk processing can be used in accordance with 
aspects of the present invention to reduce crosstalk effects to the first order The 
processing can be integrated with current digital processing without adding extra 
circuitry. After integrating the cross talk cancellation with color correction, a captured 
image will typically have more vivid-looking colors. 

Various embodiments of the invention are possible without departing 
from the spirit and scope of the invention. For example, color systems other than RGB 
can be used. The above specification, examples and data provide a complete description 
of the manufacture and use of the composition of the invention. Since many 
embodiments of the invention can be made without departing from the spirit and scope of 
the invention, the invention resides in the claims hereinafter appended. 
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